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OPTICALLY TRIGGERED INTERACTIVE AlPPARATUS AND 
METHOD OF TRIGGERING SAID APPARATUS 

This iavendon relaxes to an optically triggered interactive apparatus and a 
method of triggering said apparatus. More particularly, but not 
exclusively, the invention related to an iateractive apparaCus that is 
triggered by a broad band, broad beam, directional light scmrce and a 
method of triggering said apparatus. 



The use of light source, for example laser pointers, to trigger sensors 
mounted within a scene is loiown. The sensors are typically used to 
control the output of an audio and/ or visual data file. Such isy stems are 
found in museums, and tourist attractions, where an audio file is triggered 
15 and downloaded onto a handheld device in order to inform a user about 
their environment, or about m exhibit (the sensor being mounted near the 
exhibit) . 



Laser pointers have a problem associated with th^ in that due to their 
20 highly coIHmated nature a slight angular deflection at a laser source 
results in a deviation of the whole beam such that the beam falls off the 
sensor. The data file can stop "playback" to a user when the beam falls 
off the sensor, only to he restarted when the beam resides on the sensor 
again. This leads to a jittery^ disjointed audio-visual experience for a user 
25 of the system. Alternatively, the laser beam can be used merely to trigger 
a data fEtB that runs to completion whan triggered accidentally or a user 
has experienced the audio-visual file already. Also if a succession of 
visitors arrive at an exhibit later visitors can arrive part way through the 
playback of the data file, after the person who triggered the data file's 
30 playback has moved away. It can then be irritating for the later visitors to 
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wait for tlxe data file to play all the way through before they cm restart 
the data file. 

AdcfitLonally, due to the coherent nature of laser light, it is not readily 
possible to distinguish between laser sotirces usiag sensors used to trigger 
audio-visual displays. This makes identifying a user and tracking their 
progress around m exhibit or building very difficult. 

Another concern with the use of a laser source is the potential damage to 
eyes caused by accidental exposure to the direct laser beam. The use of 
laser beams may damage delicate artefacts due to the high intensitjr of the 
emitted radiation. 

Infira-red activated systems are also know, in which infrared beamers (like 
a TV remote control) are used to point at infrared tags that are positioned 
on a display, several such systems exist that are targeted at museums and 
galleries. The problems with these are that the infra-red radiation is 
invisible so that a user of the system cannot see wliat is being pointed at. 
sensors have to be attached to the surface, limited scale and range, and 
limited resolution. It is hard to select from many targets that are close 
together on the surface. 

The mounting of sensors within a scene can itself be problematic as 
sensors must be fbted to a point within a scene over which a user/ visitor 
point their laser. For example, the fixing of a sensor to a historic 
tapestry or work of art would present special problems. Mounting sensors 
high up, or in awkward to access areas for infra-red activated systems has 
it's own attendant problems. 

Also, should a different area of a scene be selected as a trigger area for 
an ixdra-red activated system from the one currently used, for example if 
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a mxtseum's management decide to changij m exhibit, it is necessary to 
demoimt a sensor, or disconnect it, and mount, or connect a new sensor 
in the newly selected trigger area. This can involve substantial amounts of 
work and labour to effect such a physical location of the seiasor in the 
5 target area. This provides an inertia against changing things too often. 

It is an aim of the present invention to> at least partially, ameliorate at 
least one of the above-mentioned problems and/or difficulties. 

10 According to a first aspect of the present invention there is provided an 
optically triggered interactive apparatus, comprisixLg scene capture me^j^ 
arranged to capture an image of a scene, target selection means arranged 
to select a target area within a reference image of a scetie, detection 
means arranged to detect the presence of light incident within the target 

15 area of an active video image captured by the scene capture means, the 
detection means is arranged to determine an outer extent of an illuminated 
area» illuminated by a light source, within the scene, and the detection 
means being arranged to output a trigger signal to processing means when 
a given proportion of the target area forms part of the illuminated area 

20 and/or when a given proportion of the illuminated area lies within the 
target area. 

The use of a video Images of a scene with target areas selected within the 
scene obviatea the necesiifity to attach sensors to the target areas of the 

25 scene. Additionally « a light beam can easily be seen by the user and 
Others nearby who may be Interacting with the apparatus at a distance. 
This arrangement also supports collaborative triggering. Also, a torch 
beani actually illuminates the scene so that the user can see it better - 
useful in ^laturally darV; environments or where light levels need to be 

30 kept low, for example to protect valuable artefacts that might degrade 
over time. 
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It will be appreciated that the term optical as used herein encompasses not 
only visible radiation but also infra-red and tillra-violet radiatiton. 

5 The light source may be any one, or more, of the following; broad band, 
direcsdonal* spsriially extensive. 

The scene capture means may comprise a video camera, a CCD device, or 
the like. 

10 

The illuminated area may be variable In size or.it may be fixed in size, 
typical sizes of the illuminated area range from Icm^ to 75cm^, The 
illuminated area may be as large as Im^, and possibly as maoh as* or larger 
than, 10 m*^ . The use of a beam of a sizeable, finite size reduces and ideally 
15 removes the effects of wobble and re-triggering, when a beam falls off a 
target area and back on to it, as a proportion of the beam can usually be 
maintained on the target area. The target area may range from 4cm^ to 
400ctn^, with a typical target area being approximately lOOcm^ but could 
be as large, or larger than, as 1 -lOm^, 

20 

The target selection means may comprise a graphical user interface (GUI) 
which may be ruimiag on a computer such as» for example, a personal 
computer (PC), The use of a GUI allows the simple and rapid alteration, 
for example repositioning, resizing and/or reshaping, of target areas 
25 within a captured image without having to physically move sensors. 

The detection means may comprise a signal processor. The detection 
means may be arranged to compare the reference Image with the active 
image in order to detect the presence of light Incident with the target 
30 area. The detection means may be arranged to track movement of at least 
one beain of light incident upon the scene. The detection means may be 
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arranged to monitor eithenr one. or both, of an intensity profile or, and, a 
chromatic profile of a light source, incident upon the scene. The detection 
means may be arranged to track a given light soorce. incident upon th6 
scene based upon either, or both, of the intensity profile or, tod, the 
S chromatic profile of the light source incident upon the scene. 

The detection means may be arranged to determine a oexiiroid, or other 
spatial or radiometric features, of an illuminated area within the scene 
and may be arranged to output tiie sigod] when the feature is within a 
10 target area. 

The detection means may be arranged to determine an outer extent of an 
illumiaated area within the scene and may be arranged to output the signal 
when a given proportion of the target area forms part of the illurainated 
15 area and/or when a given proportion of the illuminated area lies within 
the target area. The outer extent of the illuminated area may be 
determined by a threshold intensity, or a threshold contrast between 
adjacent regions of the illuminated area. 

20 The light source may be a torch. Torches have non-unifoim. highly 
Indi^ddual,. intensity profiles that act as fingerprints and allow them to be 
identified and possibly tracked individually upon demerging of two or 
more merged torch beams. The light source may be focusable. The light 
source may be arranged to be modulated* typically in a manner that is not 

35 visible, or not readily visible, to the human eye. The detection means 
may be arranged to increment a counter* or any other time based 
measurement, each time a given light source, or light source from a group 
of predetermiaed light sources, or any light source, illuncdnates a given 
target area. The detection means may be arranged to output a trigger 

30 signal that is dependent upon the va].ue of the counter. The actuation 
means may be arranged to output an audio, a visual or an audio- visual 
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rich media file that Is dependent upon the trigger signal output by the 
detection means. This allows a different output each time to be played to 
a user upon different occasions of the same light source illuminates a 
target area, or another particular pattern of activity, for example, when 
5 specific gesttires are detected. 

The scene capture means may include the detection means. The trigger 
signal may be transmitted wirelessly over a local area network CWLAN) 
to the actuation means. The actuation means may be arranged to output an 
10 audio, a visual or an audio-visual rich media ftte upon receiving the 
trigger signal. 

f he apparatus may comprise a pluraiity of image capture means, each of 
which may be arranged to capture an active image of the scene ► viewing 
15 the scene from different viewpoints and/or angles. The detection means 
may be arranged to receive inputs from each of image capture means and 
may be arranged to ou^ut a trigger signal to the actuation means if one 
or more target areas is illuminated in at least one of the active images. 

20 This arrangement with mtdtiple video cameras, image capture means, 
reduces the chance that an active target area will be obscured from view 
of the scene capture means by a usw or third party. 



It wHI be appreciated that the scene may be a virtual scene, for example a 
25 data construct, which may be projected on to a surface. The reference 
image may be a map of the virtual scene. Thus, it is not necessary for the 
scene to be a physical scene it may be a computer generated scene or a 
scene stored on a data storage device which may. or may not, be 
projected on to a surface. The reference scene may be an empty co- 
30 ordinate framework data structure upon which the location of a target area 
is registered. 
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According to a second aspect of the present JAvention there is provided «i 
method of optically triggering an interactive apparatus comprising the 
steps of: 

5 i) defining at least one target area within a reference image of a 
scene; 

ii) illuminating a portion of the scene with a light source; 

iii) captaring an active image of Ae scene; 

iv) determining a houndary of an area of illmnination of the light 
10 source; 

v) determining whether a predetermined fraction of the area of 
iUuroination iUtmjinates at least part of a target area; and 

vi) outputting a trigger signal if the light source illuminates at least a 
part of the target area on a predetermined manner. 



15 



30 



25 



30 



The method may include providing the light source as any one. or more, 
of the following: broad band, directional, spatially extensive. 

The method may include determining whether a oentroid of an area of 
iUtimlaatfon of the light source is disposed within at least part of a target 
area. The method mey i^cltwle determining a boundary of an area of 
iUumination of the light source and may further include determining 
whether a predetermined fraction of the area of illumination illuminates at 
least part of a target area. 

I 

Tbe method may include selecting, or defining, the target area, or areas 
by means of a graphical user interfaces. 

The method may include comparing tlie reference image with the active 
image in order to determine if a target area is at least partly iUixminated. 
The method may include identifying a light source illuminating an area of 
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the scene, for example by means of either an intensity profile or a 
chromatic profiLIe. The method may include trackiixg the movexuent an 
area of illumixiation within the $cene. 

5 The method may include tracking ilie movement of a pl«aralily of light 
sources illuminating areas of the scene. 

The method may include ftmcrementiag a counter each time a trigger signal 
is generated by a selected given light source ilhiniinating at least part of a 
10 target area, or when one of a selected group of light sources dLo so, or 
when any light source does so. The method may Include outputting a 
differing trigger signal dependent upon the value of the counter. 

The method may include outputting an audio, a visual or an audio-visual 
15 rich media file in response to a processor receiving the trigger signal. 

The method may include outputting the trigger signal via a wireless local 
area network CWLAN) to the processor. 

20 The method may include capturing a plurality of active images of the 
scene from a number of image capture means spaced thereabout. 

According to a third aspect of the present invention there is provided a 
user interface located at a user device for use in selecting a target area 
25 a corresponding output file for an optically aclivated interactive 

apparatus comprising: 

an input mechanism for selecting an area of an image displayed upon a 
ecroen of the device as a target area; 

an input mechanism for selecting the output file corresponding to the 
30 selected target area and/or another aspect of the image, the target area 
and output file having a link generated therebetween; and 
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an output mechanism arranged to output the output file upon a trigger 
condition being fulfilled. 

The trigger condition may be an image capture means capturing an image 
5 of the target area being at least partiaUy iUuminated by a broad beam 
light source 

Acx:ording to a fourth aspect of the present invention there is provided a 
method of detenx^ning user demographic statistics comprising- the steps 
10 of: 

i) providing each user wilt an identifiable light source; 

ii) recording demographic information about each user; 

iii) providing an optically triggered interactive apparatus in accordance 
with the first aspect of the present invention; 

15 iv) recording each time a target area is triggered by a user; and 

v) identifying each user by correlating their identifiable light source 
with their demographic infonnatioja. 



20 



The method may include recording how long each target area is 
illuminated by a users light source. The method may include storing the 
demographic data and the recorded data for a period of days, weelcs, or 
months. 



According to a fifth aspect of the present invention there is provided a 
25 method of defining a target area, for use with an apparatus in accordance 
with the first aspect of the present invention, within a scene comprising: 

i) displaying a reference image upon a screen; 

ii) selecting an area of a screen as a target area; and 

iii) confirming the selection of the target area. 

30 
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The method may inclxide xxsing a user manipulated device sucb as a 
keyboard, mouse, trackball or touchscreen to select the target area from 
the screen. 

5 According to a sixth aspect of the present invention there is provided a 
method of providing exhibit coxnmentary comprishag the second aspect of 
the present invention, further comprising o«tpttttitig an audio oommentary 
in response to the outpntting of the trigger signal. 

10 According to a sevendi aspect of the present invention there is provided a 
xae^od of providing an educetionai aid compriising the second aspect of 
the pre&ent invention. 

According to a eighth aspect of the present invention there is provided a 
15 method of providing an educational aid comprising the second aspect of 
the present invention. 

According to a ninth aspect of the present invention there is provided a 
computer readable mediam having stored therein instructions for causing 
20 a processing unit to execute the method of any one of the second, fourth, 
fifth, sia*h. Seventh or eighth aspects of the present invention. 

Aocordidg to a tenth aspect of the present invention there is provided a 
computer readable medium encoding a programme of instructions which 
25 when run upon a processor cause the processor to act as the detection 
means of the first aspect of the present invention. 

The invention will now be described, by way of example duly, with 
reference to the accompanying drawings, in which: 

30 




@ 014/037 



'02 16:24 PAT fH9i 

• 



BARKER BRBTTELL 



1015/037 



11 

Figure 1 is a schematio diagram of an optically controlled 
interactive apparatus according to at leart one embodiment of the 
present invention; 

Figure la is a schematic diagram of an optically controlled 
interactive apparatus according to at least one other embodiment of 
tile present invention; 

Figure 3 is a representation of a target selection GUI of the 
apparatus of Figures 1 and 1%; 

Figure 3 is a schematic representation of a centroid based beam 
location scheme; 

Figure 4 is a schematic representation of an overlap based beam 
location scheme; 



20 



25 



Figure 5 is representation of intensity profiles, of torches, used for 
Characterisation ip a« enabodiment of the present inventioni 

Figure « is a representation of a an intensity profile varying mask; 
and 

Figure 7 is a flow diagram showing a method of triggering an 
opticaUy controlled interactive apparatus according to at least one 
embodiment of the present invention. 



Referring now to Figures 1 and 2. an optically interactive apparatus 
(100). In this example for controlling audio outputs a02a-h) linked to 
30 exhibits (103a-h). comprising a video camera (104). a processor (106), a 
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graphical user interface (GUI) (107), a data store (108) and battery 
operated torches (110a,b). 



10 



Video camera (104) captures a reference image (111) of a scene (112) in 
the absence of iUmninataon from the torches (llOa.b). This reference 

image is passed tq the data store (108), a memory, from where it can be 
caUed by the proceiS^or (106). A routine that generates the GUI (107) runs 
upon the processor (106) such that the GUI (107) is output to a screen 
(114). 



The GUI (107) typioaUy comprises a define target window (116), a target 
deftoitfon parameter window (118). an output file selection window (120). 
and an active view window (122). An operator of the apparatus (100) can 
select target areas (124a-h) using the define target window (116) in which 

15 a pair of cross-hairs (126) are used to draw a box (128) about a proposed 
target area using a mouse (not shown). The target areas (I24a-h) are 
confirmed either by clicking a mouse button or by a pre-de/^ned keystroke 
on a keyboard (not shown). Alternatively, target areas (124a-h) can be 
selected by manually entering the position, location, width and height of 

20 the proposed target area in the target definition parameter window (118) 
from a keyboard. Such a "point and click" target selection arrangment is 
far more efficient than requiring the relocation of physical sensors tipon a 
display by a person as there is no need for the person to, for example, 
dimb ladders in order to remove sensors from their existing positions and 

25 place them in their new locations. Additionally, some valuable, delicate 
and oddly shapes and textured surfaces cannot have sensors put on them. 

This arrangement also allows the remote selection of targets, for example, 
targets could be selected for displays throughout a museum by a single 
30 curator in an office using this system, without the curator having to leave 
the office. The selection of target areas could be made firom anywhere in 
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the world over the Internet, which could be usefal for teachers to define 
targets and content in advance of a school visit to a musetim or even 
online players in a game to define targets and messages for their real- 
world counterparts. 

It wiU be appreciated that the observed scene may or may not he present 
upon the screen (114) during target seleotioa. The screen may display a 
data file that may be projected on to a surface. It is also envisaged that 
people could also email on files aad images for targets. 

Selection of the target areas (124a-h> can be effected manually by an 
operator or automatically by the processor rumiing pattern recognition 
software, or by a combination of tie two. For example, gross target area 
selection is carried out automaticaUy and is manuaUy fine tuned. 

FoUowing selection of a target area (134b). an output file (130) is 
associated with the target area (124b). The output file (130) is either 
selected from a list (132) displayed within the output file selection 
window (120) of the QJJl (107) or can be selected by manuaUy entering a 
■mm&m^ into ft data entry box in the target definition parameter window 
(1X8) from a keyboard. 

The video camera (104) periodically acquires an active image (134) of the 
.cene that is displayed in the active view window (122). typically every 
40m5. 



scene 
25 40m5. 



30 



The torches (llOa.b). typically eniploying broad band emission, usually 
• aie visible spectrum and any safe or economically enable parts of the 
invisible spectrum, for example infra-red or ultraviolet, and broad beam 
width. usuaUy varying form 1cm to 10 cm in width, sources, such aSv. 
ttingsteo filament, or halogen, bulbs with reflectors and lenses are 
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switched on and their beams (136a,1j) are moved across the scene. Each 
torch (110a.b) has a highly individual mtensity proffle with position 
within an iUtmiinated area which enables it to be identified and 
distinguished from the beam of other torches (llOb.a). and to be tracked 
across the scene as will be described hereinafter. Sets of partlctaar 
features within an mtensity or chromatic profUe of a torch are referred to 
as feature vectors, selection of one or more of these feature vectors 
allows the identification of a particular torch from it's beam and specific 
feature vectors can be used to track beams across a scene. 

As the torch beams (136a.b) enter one of the target areas (124a-h) their 
presence is noted by the processor which typicaUy appHes one of two 
criteria to determine whether or not to trigger the output file (130) 
associated wiHi that specific target area (1245). Different target areas can 
have different output files associated with them. In the case of an output 
me with an. audio component the audio component of the file may be 
output via open speakers, directional speakers, headphones (wired or 
wireless) or a hand held speaker device. Jn the case of an output file with 
a video component the video component of the file may be ou^ut via a 
projector, a screen or a hand held device, such as for example a personal 
digital assistant, other possible forms out output that are commonly used 
in museums include smeU and animatronic models. In deed, anything that 
responds to a control signal, for example - sliding doors, locks etc. 

The shape and area, for example the length and ratio of the principal axes 
of the elUpsoid shape, of the torch beams (136a.b) yield information 
relating to the distance and orientation of the torch from the scene, 
surface. The criteria used to identity a flashlight is described hereinafter. ' 

If a large enough target area is selected the motion of the torch beam 
(136a.b) can be tracked, it's past motion history stored and pattern 
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recognition used to identify characters, such as an alphabetic letter, a 
sj^bol Or other predetermiaed shape. Only certain recognised characters 
may be used to trigger an output file. 

5 One method of locating a torch beam within a scene is to subtract the 
reference image from the active image to leave a difference image. The 
positions of the torch beams witihin the scene will be evident from this 
difference image as compared to the reference image. 

10 Trigger criteria are now described with reference to Figures 3 and 4. One 
method is to use a beam centrold location scheme for a torch beam (300). 
This hivolves an outer locus (302), or periphery, being determiued for the 
beam (300), typically where the intensity of the beam (300) falls below a 
threshold value, or the contrast between adjacent regions of the beam is 
13 above a threshold value, and a geometric centroid (306) of the beam (300) 
to be calculated by the processor (106). The location of this calculated 
geometric centroid (306) is then taken to be the location of the beam 
(300), Thus, when the processor (106) detects the centroid (306) eirtering 
the target area (124b) withm the active image (134) it triggers the output 
20 file (130) associated with the target area (124b) . 



A second, and in many Instances preferred method is to use a beam 
overiap location scheme for a torch beam (400). This involves the 
determination of an outer locus (403). or periphery, of the beam (400). 
This typicaUy involves determining where the intensity of the beam (400) 
faUs below a threshold level, or where the contrast between adjacent 
regioilfi of the observed beam area have a contrast greater than a threshold 
value. When the processor (106) detects the outer locus (402) crossing the 
boundary of the target area (134b) a routine is run that calculates how 
much of the beam (400) overlaps the target area (124b). This routine is 
run upon the processor (106) as long as the beam (400) is detected within 
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the target area (124b). The output file (130> will only be triggered when a 
thresshold amount, for example 50%, of the area contained within the 
outer locus (402) is detected within the target area (124b), 

5 Alternatively, instead of, or in addition to evaluating how much of the 
beam area is within the target area, an evaluation may be made of how 
much of the target area is overlapped by beam area. The threshold level 
of the beam profile may be set such that It is neoessary to have two or 
more beams at least panially overlappiTig m order to trigger certain 
10 responses. This encourages co-operation between and may be particularly 
useful in, for. example, an educational or gaming application for cWlciren 
that encourages social inieraction between participants . 

Due to the sizeable finite area and shape of the torch beams (136a,b) each 
15 beam (136a,b) can sweep out an area and can trigger multiple target areas 
(l24a-h) simultaneously. This is not possible with a laser pointer due to 
the small cross-sectional area of the beam. 

It is possible to configure target areas to generate a trigger signal in 
20 response to only certain torches profiles, for example, not aU targets are 
necessarily live for eveiy member of a group. It is also possible to link 
different output files to a target depending upon which torch iUuminates 
the target, for example, a simple explanation of an exhibit can be output 
for a torch given to younger children, an intermediate explanation can be 
25 output for a torch given to older children and a detailed explanation can 
be output for a torch given to adults. 



In one embodiment the torch beams (136a.b) are modulated, typically by 
the imposition of a signal to the supply voltage, such that the modulaticn 
is not visible to the naked eye but can be captured by the video camera 
(104). Such a modulation signal can be used as an identifier to identify 
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the torch (110a,b) or alternatively, if switched on, for example by an 
action of a user such operating a switch, can be used in an analo^ou^s 
fashion to a ^motise click' to allow selection of a target area and not allow 
selection of a target area when switched off. That is to say, a torch itself 
5 can be used to select and/or define target areas in the observed scene. 

It \viU be appreciated that xntiXtlpIe video camersis can be positioned 
dJCOUnd the scene in order to provide a number of viewing angles for the 
scene. Inputs from the video cameras are fed to the processor (106) and 

10 the same target areas (124a-h) defined in reference views of the scene 
from each video camera. This reduces effect of obscuration of a target 
area by a user or third party as the target area resulting in failure to 
generate a trigger signal as the target area will remain visible from 
anothi^r video camera which can trigger the output file upon the torch 

15 beam illuminating the target area. 

In a preferred embodiment the processor (106) maintains a history, for 
example a counter (138) for each torch beam (136a,b), identified either 
by their intensity or chromatic profiles. Such an identification can be used 
20 to distinguish trigger torches from other light sources such as reflections 
of the sun from a reflective surface. 

The use of the intensity profiles of torch beams (136a, b) to identify 
torches (110a,b) is detailed with reference to Figures 5 and 6. A cross- 

25 section of intensity profiles (502,504) of two torches (IJOajb) show 
marked differences. These profile differences can be due to 
manufacturing tolerances in the production of parabolic reflector mirrors » 
lens pieces and bulbs that make up the light emitting portion of a torch. 
The profile differences enable the processor (106) to distinguish between 

30 different torches and can be used as to identify specific torches even after 
torch beams have crossed and demerged. This is not readily achieved with 
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laser pointers as there Is not sufficient structure in the bearo profile to 
identify individual pointers easily. 

latensity profile differences can be enhanced by the use of a patterned 
5 mask (600) for placement over an output, such as a lens, of the torch. 
The mask (600) can be a simple cut-away mask to provide abrupt changes 
in intensity profile. Alternatively, fhe mask (600) be formed of regions of 
neutral density filter of varying thickness to provide either gradual 
alteration of the intensity profHe or abrupt changes in the intensity 
10 profile. 

The counter (138) is used to monitor each time a given target area (124a- 
h) is triggered. This allows the collection of user data for analysis 
purposes such as, for example* determining the optimum location of 

15 target areas within a scene, and user demographic preferences for areas 
searched for tar^t areas. The use of the counter (138) also allows 
different output files to be output depending upon how many times a 
user's torch beam (136a,b) has triggered a given target area. This results 
in increased user interest in a display and provides the opportunity for 

20 layered information dissemination,, for e;<ample» different chapters of a 
story to be displayed each time a given torch beam (I36a,h) triggers a 
given target area <124b). or more details being given at successive visits 
to the same target by a ixser, 

35 It Is also envisaged that the video camera (104) and processor (106) can 
be used to track shadows cast by the torch beams (136a,b). 

Referring now to Figure la, a second embodiment of an optically 
triggered interactive apparatus (150) comprises a video camera (152), 
30 output devices (156a-o), a control unit (159) and battery operated torches 
(158a,b). The camera (152) contains an integral processor (160). data 
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Store (162) and a wireless transceiver (164). Tte output devices (156a-c) 
comprise, in this sxample, an audio output (166). a wireless transceiver 
(168) and data store (170). The control unit (159). typicaUy a l^op 
computer or a PC, comprises a scraan (172), a processor (174), a (fata 
5 store (176) and a wireless transceiyer (178). 

In a set up configuratioii the control unit (15$) is connected to the video 
camera (152) either via their respBCtitve wireless transceivers (178,164), 
typlcaUy IEE802.11. Bluetooth or Firewire Unk, or via a hardwired link, 
10 for example via a Universal Serial Bus (USB) cable. Target areas are 
defined on via a GUI displayed on the screen (172) of the control unit 

(159) . as described hereinbefore with reference to Uie first embodiment of 
the invention. 

15 Data corresponding to the target areas and their associated output files are 
transmitted via the connection between the camera (152) and the control 
unit (159) to the processor (160) and data store (162) of the camera (152). 

The comiecfion between the camera (152) and the control unit (159) can 
20 now be broken and the camera (152) assumes control of the triggering 
operation for the output devices (156a-o) using the integral processor 

(160) and data store (162). The triggering of the output devices (156a-c) 
is typically effected using one of two criteria to detennine whether or not 
to trigger the output file (130) associated with that speoifio target area 

25 (124b) . The trigger criteria have been desCTlbed hereinbefore. 

The camera (152) nsuaUy triggers an output device (156a-c) by sending a 
trigger signal to the output device via their respective wireless 
transceivers (164. 168) and an output data fUe associated with the trigger 
30 signal sent is called from the output device's data store (166). 
Alternatively, an output data file can be recalled from the camera's data 
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Store (162) and transmitted to the output device via their respective 
wireless transceivers (164,168). 

It wiU be appreciated that variations described in relation to the first 
. 5 embodiment of the present inventiLon. for example multiple camera 
positions and the tise of a counter, are equally applicable to the second 
embodiment of the present Invention. 

Referring now to Figure 7, a method of optically triggering an interactive 
10 apparatus comprises capturing a reference image of a scene (Step 700) t 
defining at least one target area within the reference image of the scene 
(Step 702), iUutninating a portion of a scene with a totch (Step 704), 
capturing an active image of the scene (Step 706) determining whether the 
torch flluminates a least a part of a target area (Step 70S) and outputtiag a 
15 trigger signal if the torch illmnioates at east a part of the target area in a 
. predetermined manner (Step 710), 

Although described with reference to the output of audio data files it will 

be described that the present invention is equally applicable to the 

20 outputting of visual, video and audio- visual data files and also 

animatronics, smells etc as noted hereinbefore. Indeed it is envisaged that 

the present invention may be employed in, for example, audio tours of 

museums, castles, churches* stately home, caves, mines, dungeons, 

quarries or cellars, interactive posters (e.g. at tradeshows, exhibitions 

I 

25 and conferences), interactive rides (e.g. in themeparfcs), interactive 
children's toys, inlBractive signposts and advertising thereupon, 
interaction in lecttire theatres, and auditorial for example to allow voting 
and selection* interactive wall displays (e.g. in a classroom) and Do-It- 
Yourself (DIY) applications, for example identifying the location of pipes 

30 and/or wires behind plaster to prevent drilling into the pipes and/or 
wires. 
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A security system that monitors the progress of security guards and 
restricts access to designated areas based upon identifying torches used by 
security staff by their Intensity or chromatic profiles is envisaged. Such a 
5 system could also be used to identify intruders usitxg torches by their use 
of a non-known Intensity profile. 

The use of video tracking of a torch, as described hereinbefore, has a 
number of advantages over the prior art arrangements including that 

10 where a visible torch are used both the user and others nearby can see 
where the torch are pointing/ The torch provides illuminatioit) for targets 
in low lighting environments > for example caves » or where strong light 
can cause degradation of an exhibit such as ajo ancient painting or 
tapestry. Such a system allows users to interact with exhibits at a 

15 distance, for example when standing behind a protective barrier. 

Additionally, such a system does not require target areas to be visible, 
i,e. the targets can be hidden, utjb'ke some prior an systems, as they are 
regions defined in a computer program and allows monitoring of the 

20 whole of a scene, surface, of interest. The monitoring of the whole of the 
surface is useful as it allows statistics to be acquired relating to the areas 
where a user expects to find a target area and allows a controller to alter 
the posidon of targets accordingly, should they wish to do so. The 
monitoring of the whole area of the surface allows a sJgfiial to be output ixi 

25 response to how close a user's torch beam is to a target area, for example 
an audible sound may increase in volume as a beam moves closer to a 
target and may decarease in volume the further away from a target the 
beam moves. 

30 It will be appreciated that although described in relation to torches 
(flashlights) the present invention can be applied to any video tracked 
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broad beam light source for example a car headlight or a searchlight on a 
face of a building. 

It will further be appreciated that the scene and the target areas may form 
part of a video image that changes with time. The target areais may 
therefore not be static within the scene viewed by the video camera bttt 
may move within the scene. 
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CLAIMS 

1. An optically triggered interactive apparatus , comprising scene 
capture means arranged to capture an image of a scene, target selection 
5 means arranged to select a target area within a reference image of the 
scene» detection means arranged to detect the presence of light incid&nt 
within the target area of an active video image captured by the sceixe 
capture means ^ the detection means is arranged to determine an outer 
extent of an illuminated area» illmxiinated by a light som-ce, within the 
10 scene, and the detection meani^ being arranged to output a trigger signal 
to processing means when a given proportion of the target area forms part 
of the illuminated area and/or when a given proportion of the illuminated 
» area lies within the target area. 

15 2. Apparatus according to Claim I wherein the light source is any 
one, or more, of the following: broad band, directional, spatially 
extensive. 

3. Apparatus according to either of Claims 1 or 2 wherein the scene 
20 capture means is a video camera, a CCD device or the like. 

4. Apparatus according to any preceding claim wherein the target 
selection means Is a graphical user interface (GUI) , 

25 5. Apparatus according to any preceding claim wherein the detection 
means is arranged to compare the reference image with, the active image 
in order to detect the presence of light incident with the target area. 

6. Apparatus according to any preceding claim wherein the detection 
30 means is arranged to track movement of at least one beam of light 
incident upon the scene. 
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7. Apparatus accordlag to any preceding claim wherein the detection 
means Is arranged to monitor either, or both, of an intensity profile or, 
and> a chromatic profile of a light source* incident upon the scene. 

8. Apparatus according to any preceding claim wherein the detection 
means is arranged to track a given light source, incident upon the scene 
based upon whether^ one, or both, of the intensity profile or, and, the 
chromatic profile of the light source incident upon the scene. 

9. Apparatus according to any preceding claim wherein the light 
source is arranged to be modulated. 



10. Apparatus according to any preceding claim wherein the light 
15 sotirce is a torch, 



11. Apparatus according to any preceding claim wherein the detection 
means is arranged to increment a cotmter each time a given light source 
passes over a given target area. 

20 

12, Apparatus according to Claim 11 wherein the detection means is 
arranged to output a Ltigger signal that is dependent upon the value of the 
comiter. 

25 13. Apparatus according to Claim 12 wherein the actuation means is 
arranged to output an audio i a visual or an audio- visual rich media file 
that is dependent upon the trigger signal output by the detection means. 

14. Apparatus according to any preceding claim wherein the scene 
30 capture means include the detection means. 
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15. Apparatus according to aay preceding claim wherein the trigger 
signal are transmitted wirelessly over a local area network (WLAN) to the 
actuation means. 

16. Apparatus according to any preceding claim wherein the actuation 
means is Eoranged to output swx audio, a visual or an audio- visual rich 
media file upon receiving the trigger signal. 

17. Apparatus according to any preceding claim comprising a plurality 
of image capture means, each of which are arranged to capture an active 
image the scene £rom different angles. 

18. Apparatus according to Claim 17 wherein the detection means are 
be arranged to receive inputs from each of image captured means 

19. Apparatus according Claim 18 wherein the detection means is 
arranged to output a trigger signal to the actuation means if one or more 
target areas is UJtiminated in at least one of the active images. 

20. Apparatus according to any preceding claim wherein the scene is a 
virtual scene and the reference image is a map of the virtual scene. 

21. A method of optically triggering an interactive apparatus 
comprising the steps of: 

i) defining at least one target area "wrifbin a reference image of a 
scene; 

ii) iUuminating a portion of the scene with a light source; 
ill) capturing an active image of the scene; 

iv) determining a boundary of an area of illumination of the light 
source; 
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v) determining whether a predetermined inaction Of the area of 
illnmination illnminates at least part of a target area; and 

vi) outputting a trigger signal if the light source illttmmates at least a 
part of the target area on a predetennined manner. 

5 

22. The method of Claim 21 including selecting the target areas by 
means of a graphical user interface. 

23. The method of either of Claims 21 Or 22 including comparing the 
10 reference image with the active image in order to determine if a target 

area ia at least partly illuminated. 

24- The method of any one of Claims 21 to 23 including identifying a 
li^t sotu-ce iUxmiinating an area of the sc©Re by xoemB of either an 
15 intensity profile or a chromatic: profile. 

25. The method of any one of Claims 21 to 24 including tracking an 
area of illumination within the scene. 

20 26, The metibod of any one of Claims 21 to 25 including tracking a 
plurality of light sources illuminating areas of the scene. 

27. The method of any one of Claims 21 to 26 ixicluding incrementing 
a coiuiter each time a trigger signal is generated by a given light source 
25 iUuminating at least part of a target area. 



28. The method of Claim 27 including outputting a differing trigger 
signal dependent vpon the value of the counter. 
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29. The method of any one of Claims 21 to 28 including outputting an 
audio, a visual or an audio-visual rich media file in response to a 
processor receiving the trigger signal, 

S 30. The method of any one of Claims 21 to 29 including outputting the 
trigger signal via a wireless local area network (WLAN) to the processor. 

31. The method of any one of Claims 21 to 30 including capturing a 
plurality of active images of the scene from a number of image capture 

10 means spaced thereabout. 

32. A user interface located at a user device for use in selecting a 
target area and a corresponding oxitput file for an optically activated 
interactive apparatus comprising: 

15 ati input mechanism for selecting an area of an image displayed npon a 
screen of the device as a target area; 

an input mechanism for selecting the output file corresponding to the 
selected target area and/or auother aspect of the image, the target area 
and Output file having a link generated therebetween; and 
20 an output mechanism arranged to output the output file upon a trigger 
condition being fulfilled. 

33. A user interface according to Claim 32 wherein the trigger 
condition is an image capture means capturing an image of the target area 

25 being at least partially iUuminated by a broad beam light scarce 

34. A method of detennining user demographic statistics comprising 
tiie steps of: 

i) providing each user with an identifiable light source; 
30 11} recording demographic information about each user; 
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iii) providing an optically triggered interactive apparatus according to 
any one of Claims 1 to 20; 

iv) recording each time a target area is triggered by a user^ and 

v) identifying each user by correlating theii- identtfiable light source 
5 with their demographic information. 

35. The method according to Claim 34 including recording hqw long 
each target area is iUtiininated by a users light source. 

10 36. The method according to either of Claims 34 or 35 including 
storing the demographic data and the recorded data for a period of days, 
weeks* or months. 

37. A method of defining a target area, for use with an apparatus in 
15 accordance any one of Claims 1 to 20, within a scene comprising: 

i) diiSplaying a reference image upon a screen; 

ii) selecting, an area of a screen as a target area; and 
lii) confirming the selection of the target area, 

20 38. The method of Claim 37 including using a user mtoipulated device 
such as a keyboard, mouse, trackball or touchscreen to select the target 
area from the screen, 

39. A computer readable medium having stored therein instructions for 
25 cau^g a processing unit to execute any one of the methods of any one of 

Claims 20 to 38. 

40. A computer readable medium encoding a programme of 
instructions which when run upon a processor cause the processor to act 

30 as the detection means of any one of Claims 1 to 20. 
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ABSTRACT 



OPTICALLY TRIGGERED INTERACTIVE AJPPARATUS AND 
METHOD OP TRIGGERING SAID APPARATUS 

An optically triggered fnieractive apparatus (lOO). comprises a video 
camera (104) arranged to capture a reference video image of a scene 
(112). A graphical user interface (107) used to select a target area 
(124b) within the reference video image. A proceisor (106) arranged to 
detect the presence of light incident within the target area (I24b) of an 
active video image captured by the video camera (104). The processor is 
arranged to determine an outer extent of an torch beam (136a.b) within 
the scene (112) and outputs a trigger signal to a ftirther processor (102a- 
h) when a given proportion of the target area forms part of the 
15 iUwminated area and/or when a given proportion of the iUuminated area 
lies within the target area. 

To be accomfjanied. when published, by Figure 1 of the drawings. 

20 
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